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FOREWORD 


Among  the  responsibilities  assigned  to  the  Office  of  the  Manager, 
National  Communications  System,  is  the  management  of  the  Federal  Tele- 
communication Standards  Program  which  is  an  element  of  the  overall  GSA 
Federal  Standardization  Program.  Under  this  program,  the  NCS,  with 
the  assistance  of  the  Federal  Telecommunication  Standards  Committee, 
identifies,  develops,  and  coordinates  proposed  Federal  Standards  which 
either  contribute  to  the  interoperability  of  functionally  similar  Federal 
telecommunication  systems  or  to  the  achievement  of  a compatible  and 
efficient  interface  between  computer  and  telecommunication  systems. 

In  developing  and  coordinating  these  standards  a considerable  amount 
of  effort  is  expended  in  initiating  and  pursuing  joint  standards  develop- 
ment efforts  with  appropriate  technical  committees  of  the  Electronic 
Industries  Association,  the  American  National  Standards  Institute,  the 
International  Organization  for  Standardization,  and  the  International 
Telegraph  and  Telephone  Consultative  Committee  of  the  International 
Telecommunication  Union.  This  Technical  Information  Bulletin  presents 
an  overview  of  an  effort  which  is  contributing  to  the  development  of 
compatible  Federal,  national,  and  international  standards  in  the  area 
of  digital  facsimile  standards.  It  has  been  prepared  to  inform  interested 
Federal  activities  of  the  progress  of  these  efforts.  Any  comments, 
inputs,  or  statements  of  requirements  which  could  assist  in  the  advance- 
ment of  this  work  are  welcome  and  should  be  addressed  to: 


Office  of  the  Manager 
National  Communications  System 
ATTN:  NCS-TS 
Washington,  D.C 
(202)  692-2124 
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1.0  Introduction 

This  document  summarizes  the  work  performed  by  Deltfc  Information 
Systems,  Inc.  for  the  National  Communications  Systems  agency  of  the 
TJ.  S.  Government  under  Purchase  Order  DCA100-79-My003U.  The  Statement 
of  Work  of  the  subject  Purchase  Order  required  the  determination  of 
"the  criteria  for  evaluating  the  technieal/eeonomic  merits  of  various 
data  two-dimensional  algorithms/coding  techniques  for  digital  facsimile 
terminals  being  proposed  for  adaption  as  an  international  standard  by 
the  CCITT . " 

The  Statement  of  Work  described  the  background  of  this  contract 
as  follows: 

The  International  Telegraph  and  Telephone  Consulta- 
tive Committee  (CCITT)  Study  Group  (SG)  HV  is  respon- 
sible for  the  development  of  facsimile  standards  in 
the  international  arena.  Many  of  the  parameters 
relating  to  interoperability  of  facsimile  apparatus 
have  been  identified  and  agreed  upon.  However,  one 
area  which  remains  to  be  resolved  involves  compression 
algorithms/coding  techniques  5 more  specifically  two 
dimensional  compression  algorithms.  During  the  period 
11-15  December  1978,  Working  Party  2 of  CCITT  SO  XIV 
will  meet  in  Geneva,  Switzerland.  The  subject  of  two 
dimensional  compression  algorithms  will  be  an  agenda 
item.  The  Japanese  have  already  submitted  a contri- 
bution on  this  subject.  Other  contributions  are 
anticipated  at  the  11-15  December  meeting.  What  will 
be  lacking  as  a common  criteria  against  which  to 
evaluate  the  relative  technical/economic  merits  of 
competing  two  dimensional  compression  algorithms. 

The  purooee  of  this  contract  is  to  provide  these  coranon  criteria. 

The  work  on  the  subject  contract  was  performed  by  Richard  Schaphorst 
and  Neil  Randall  of  Delta  Information  Systems,  Inc.  and  guided  by  Dennis 
godson,  the  Contractors  Technical  Representative  from  the  National 
Communications  System.  We  also  wish  to  acknowledge  the  helpful  discussions 
with  the  following  members  of  the  ZIA  TR-29  Facsimile  Systems  and 


This  task  occupied  the  major  portion  of  the  contract.  Daring  this 
effort,  basic  documents  such  as  those  References  listed  in  Appendix  A 
(Section  U.O)  were  reviewed  to  determine  their  applicability  to  the  issue 
at  hand.  Several  CCITT  documents  mentioned  four  criteria  for  the  evalua- 
tion of  data  coeipresslon  techniques  as  listed  below. 

e Compression  Factor 
e Error  Sensitivity  Factor 
e Cost  of  Implementation 
e Comonality  with  other  Facsimile  Codes 
These  criteria  were  discussed  with  various  members  of  the  EXA  Facsimile 
Committee  and  there  was  general  agreement  that  they  be  proposed  in  the 
CCITT  paper. 

Following  the  identification  of  the  evaluation  factors,  each  was 
next  defined.  During  the  definition  process,  many  alternative  specifica- 
tion concepts  and  approaches  were  considered.  Sections  3.0,  U.O,  5.0 
and  5.3  present  the  various  alternatives  which  were  evaluated  for  each 
criteria  and  the  rationale  for  selecting  the  particular  definitions  which 
are  proposed.  Section  7.0  discusses  the  various  oroceduree  and  techniques 
which  were  considered  for  ranking  the  relative  importance  of  the  criteria. 


1 - Identification  and  Definition  of  Evaluation  Criteria 


Equipment  Engineering  Committee:  Charles  Jacobson,  Robert  Krallinger, 
Tim  McCullough,  A.  Schmidt,  Lou  Cartolano,  and  Forrest  Smith. 

of  the  Work  Performed 


Work  on  the  subject  contract  was  divided  into  the  three  major  tasks 
discussed  in  the  paragraphs  below— (1)  Identification  and  Definition  of 
Evaluation  Criteria  (2)  CCITT  Contribution  (3)  Final  Report. 
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Aa  the  various  definitions  were  evolved  during  the  course  of  the  contract, 
great  benefit  waa  derived  from  discussion  with  various  members  of  the 
KIA  Facsimile  Committee. 

2 - CCITT  Contribution 

The  Statement  of  Work  calls  for  the  submittal  of  a draft  copy  of  a 
"TJ.  S.  contribution  to  CCIR  Study  Oroup  H7".  . ."for  evaluating  compet- 
ing two  dimensional  compression  algorithms/coding  techniques."  It  further 
specifies  that  the  "contribution  be  furnished  at  the  time  of  submission 
of  the  final  report."  In  compliance  with  this  requirement,  the  draft 
copy  is  included  as  Appendix  A.  It  should  be  noted  that  a copy  of  this 
proposed  contribution  was  submitted  to  the  C.O.T.R.  on  November  20,  1978. 

3 - Final  Reoort 

The  final  report  summarizing  all  work  performed  on  the  subject  control 
is  submitted  herewith.  In  addition  to  describing  the  work  done.  Section 
9.0,  which  contains  recomendations  for  further  study,  has  been  included. 


3.0  Compression  Factor 

One  of  the  most  critical  parameters  in  the  selection  of  a compression 
coding  technique  is  the  compression  factor  which  measures  the  ability  of 
the  algorithm  to  reduce  redundancy  in  the  input  data  and  thereby  reduce  the 
number  of  bits  required  for  transmission.  Several  terms  have  been  used  to 
represent  this  compression  parameter  — compression  ratio,  compression  factor, 
and  reduction  factor  to  name  a few.  In  addition, some  experimenters  have 
chosen  to  describe  the  compression  performance  entry  in  terms  of  transmission 
time  over  a given  data  link.  In  this  paper  the  term  Compression  Factor  (CF) 
has  been  chosen  and  is  defined  as  the  number  of  picture  elements  in  the 
document  to  be  transmitted  divided  by  the  number  of  cods  bits  required  for 
transmission  of  that  document. 

There  are  three  issues  related  to  the  Compression  Factor  which  require 
further  discussion  — (1)  selection  of  the  test  documents,  (2)  03  machines, 

(3)  Gb  machines.  These  issues  are  analyzed  in  the  paragraphs  below. 

e Selection  of  Test  Documents 

It  is  generally  recognized  that  the  Compression  Factor  must  be  measured 
using  actual  representative  graphic  material  as  the  input  as  opposed  to  hypo- 
thetical patterns  of  test  data.  It  would  be  desirable  for  the  test  documer.t(s) 
to  represent  the  full  range  of  material  which  might  be  handled  by  the  G3/Gb 
facsimile  equipment.  For  example,  users  may  occasionally  transmit  a half-tone 
image  or  a continuous  tone  photograph  though  it  was  not  designed  for  that 
purpose . 

In  addition,  it  would  be  desirable  for  the  test  document(s)  to  reflect, 
as  accurately  as  possible,  the  statistical  distribution  of  the  documents 
which  would  be  actually  transmitted.  For  example,  if  most  of  the  transmitted 
documents  contained  typed  text, then  a code  which  has  a relatively  high  compress 


ratio  for  textual  data  should  b«  favored.  Unfortunately  there  is  very 
little  published  information  on  the  distribution  of  documents  transmitted 
through  facsimile  networks. 


Another  criterion  for  the  selection  of  test  documents  is  precedent  - 
ie.  what  documents  bave  been  used  for  similar  measurement  purposes  in  the 
past.  The  8 CCITT  test  documents  shown  in  Figure  l.C,and  listed  below, 
have  achieved  a wider  range  of  acceptance  than  other  documents  and  are  also 
somewhat  representative  of  the  pages  likely  to  be  transmitted  through  the 
Q3/GU  machines. 

Description 


Document  No. 


1 

2 

3 

U 

5 

6 

7 

8 


Business  letter  with  logo  and  signature 

Circuit  diagram 

Invoice 

Typed  French  text 
Text  and  Figures 
Graph 

Japanese  characters 
Handwritten  memo 


Consequently,  the  8 CCITT  documents  have  been  selected  for  use  in  this  proposal. 

The  Freeh  PTT  Administration  has  scanned  these  8 CCITT  documents  at  both 
the  standard  and  high  resolutions  as  specified  for  Group  3 machines.  They 
have  also  quantized  each  pel  to  be  either  black  or  white  and  stored  the  re- 
sultant image  on  magnetic  tape.  Further,  the  French  PTT  has  provided  copies 
of  these  tapes  to  experimenters  in  the  data  compression  field  so  that  fac- 
simile performance  data  can  be  compared  on  a meaningful  basis.  For  these 
reasons,  it  is  recommended  that  the  proposed  measurements  be  performed  using 
the  tapes  supplied  by  the  French  PTT  Administration. 


e CF  Measurement  for  G3  Machines  (CF  -Q 

It  is  desirable  to  measure  the  CF  using  simulated  conditions  which  are 
as  realistic  as  nossible.  Since  the  CF  for  G3  machines  can  be  significantly 
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impacted  by  the  number  of  transmitted  Fill  hits.  they  raus*  be  included  in 
the  simulation.  In  order  to  simulate  the  Fill  function  the  minimum  line 
transmission  time  and  the  transmission  bit  rate  must  be  specified.  Sinco 
ms  is  the  standard  minimum  line  transmission  for  03  machines  it  was 
selected  for  the  proposal.  A data  rate  of  U800  bits/sec.  was  chosen,  since 
it  is  considered  typical  for  03  application. 

It  is  further  recommended  that  the  G3  simulation  include  all  synchroni- 
sation bits  such  as  the  beginning-of-message,  end-of-line,  and  end-of-message. 
It  is  not  expected  that  these  bits  will  significantly  impact  the  measured 
CF  parameter,  but  it  is  desirable  to  insert  them  into  the  transmitted  code 
bits  so  that  the  simulation  output  magnetic  tape  can  be  used  directly  for 
measurement  of  error  sensitivity.  In  addition  the  inclusion  of  these  syn- 
chronization does  make  the  measured  CF  more  precise. 

e CF  Measurement  for  Gb  Machines  (CF),) 

The  Gti  facsimile  machines  will  be  operating  over  Public  Data  Networks. 

In  this  application  it  is  not  anticipated  that  Fill  bits  will  be  required. 

In  addition  the  error  rate  of  the  data  networks  are  expected  to  be  sufficiently 
low  that  error  sensitivity  will  not  be  a significant  factor  in  code  selection. 
Therefore  there  will  be  no  need  to  prepare  a magnetic  tape  with  synchronization 
bits  for  subsequent  error  sensitivity  analysis.  For  these  reasons  it  is  pro- 
posed to  measure  the  CF  for  Gh  machines  using  transmitted  code  bits  which 
contain  no  synchronization  or  fill  bits. 

• Measurement  Data 

It  is  nroocsed  to  measure  CF-j  and  CF*  for  both  the  3.35  and  7.7  lines/mm 
resolution  for  all  8 CCITT  test  documents.  The  potential  desirability  of 
computing  average  CF  parameters  for  the  3 test  documents  was  considered. 

-7- 


However,  this  was  rejected  because  it  would  infer  an  equal  weighting  to 
each  of  the  test  documents,  which  is  probably  not  a valid  assumption. 


U.O  Error  Sensitlvit; 
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In  addition  to  Compression  Factor,  it  is  important  to  evaluate 
coding  techniques  for  their  sensitivity  to  transmission  errors,  particu- 
larly for  the  Oroup  3 machines.  The  typical  application  for  Group  3 
machines  involves  transmission  over  dialed  telephone  lines  using  modems 
that  do  not  have  error  control.  Under  these  conditions  transmission 
errors  can  become  significant,  and  with  some  coding  techniques  the  errors 
could  be  propagated  over  a large  part  of  the  picture,  causing  unacceptable 
results.  With  the  Oroup  U machines,  the  transmissions  themselves  will  be 
provided  with  error  protection,  so  that  few  errors  will  reach  the  facsimile 
decoder.  Thus,  the  evaluation  of  error  sensitivity  is  recommended  only  for 
Group  3 machines.  However,  since  it  is  expected  that  the  Group  3 and  Group 
h codes  will  be  the  same,  it  may  be  desirable  to  evaluate  a proposed  Group 
U coding  technique  to  determine  if  it  is  also  suitable  for  Group  3 machines. 

It  was  felt  that  both  an  Objective  and  a Subjective  measure  of  error 
sensitivity  was  required.  Fortunately,  both  can  be  obtained  without  an 
increase  in  simulation  effort.  The  Objective  measure  is  a numerical  value 
representing  the  number  of  pels  that  are  represented  incorrectly  by  the 
decoding  algorithm,  divided  by  the  number  of  bits  that  were  in  error  in  the 
corresponding  transmission.  The  Subjective  measure  will  consist  of  pre- 
senting, for  committee  evaluation, images  that  have  been  corrupted  by  errors, 
in  order  to  determine  the  nature  of  the  image  errors,  and  how  noticeable 
or  objectionable  they  are. 

4.1  Test  Documents 

In  order  to  minimize  the  computer  time  required  for  the  error  sensi- 


tivity measurement,  not  all  of  the  test  documents  used  for  the  CF  tests 


m 


will  be  used  for  error  sensitivity  measurements.  Two  of  the  eight  CCITT 
test  documents  have  been  selected  for  error  tests.  Both  are  mostly  typed 
text,  which  is  expected  to  constitute  a large  portion  of  the  total  traffic. 
CCITT  Test  Document  1 was  selected  as  typical  of  documents  having  high 
compression  factors,  and  should  serve  to  exhibit  errors  as  black  marks  in 
the  large  white  areas  of  the  document.  CCITT  Test  Document  h was  selected 
as  typical  of  documents  having  low  compression  factors,  and  should  serve 
to  exhibit  possible  intelligibility  problems.  Each  of  these  Test  Documents 
will  have  been  encoded  in  the  course  of  measuring  the  CF,  so  the  encoding 
need  not  be  repeated.  The  encoding  used  for  measurement  of  CF^,  which 
includes  synchronization  and  fill  bits,  will  be  used,  since  transmission 
errors  are  associated  with  Group  3 machines.  The  encodings  for  standard 
and  high  resolution  will  be  used  in  the  error  sensitivity  test. 

U.2  Error  Patterns 

To  measure  the  error  sensitivity,  the  encoded  bit  streams  are  cor- 
rupted by  an  error  pattern  that  reverses  selected  bits.  In  order  to  pro- 
vide a repeatable  test,  it  is  not  possible  to  use  random  error  sequences 
generated  by  the  computer  performing  the  simulation,  since  each  such 
sequence  would  be  different.  It  would  be  possible  to  generate  a single 
random  sequence  to  be  used  by  all  experimenters,  but  this  would  not  pro- 
vide an  important  characteristic  of  real  circuit  noise:  the  fact  that 
errors  appear  in  bursts.  It  would  be  possible  to  produce  artificial  error 
patterns  with  burst  characteristics,  but  it  was  Judged  easier  and  more 
realistic  to  make  a record  of  an  actual  error  pattern  for  use  by  all 
experimenters . The  error  pattern  should  be  obtained  by  transmission 
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over  switched  telephone  links  that  are  expected  to  be  typical  for  the 
Group  3 machines.  Therefore,  it  was  recommended  that  U800  bits/sec  with 
a V27  ter  modem  be  used. 

The  bit  error  rate  should  be  high  enough  to  cause  a large  number  of 
bit  errors  in  each  image,  in  order  to  minimize  the  number  of  images  that 
must  be  processed  to  obtain  a statistically  significant  sample.  Note  that 
processing  time  is  almost  entirely  dependent  on  the  number  of  images  pro- 
cessed,  and  hardly  at  all  on  the  number  of  bit  errors  encountered.  The  fact 
that  the  error  rate  is  higher  than  that  usually  encountered  on  high-quality 
circuits  is  not  important,  since  the  effect  of  a lower  error  rate  can  be 
extrapolated  from  the  high  error  rate  case.  An  upper  limit  on  the  error 
rate  is  placed  by  the  requirement  that  a single  line  should  not  frequently 
encounter  more  than  one  error  burst.  If  this  occurred,  it  would  be  diffi- 
cult to  extrapolate  the  test  results  to  lower  error  rates.  The  number  of 
bits  per  line  must  be  at  least  hQ  even  in  blank  areas  because  of  the 
required  fill  bits,  and  could  be  U32  bits  if  the  compression  factor  is  U. 

The  error  rate  that  has  been  selected  is  10"^,  or  an  average  of  1 error  in 
1 ,000  transmission  bits,  which  is  less  than  1 per  line,  even  in  "busy" 
areas.  The  probability  of  a line  of  U32  bits  encountering  more  than  one 
error  if  the  bit  errors  are  selected  at  random  is  cnly  0.07.  This  becomes 
even  lower  when  the  fact  that  errors  occur  in  bursts  is  considered.  For 
example,  if  the  average  number  of  error  bits  in  a burst  is  5,  the  proba- 
bility of  sore  than  one  burst  in  1*32  bits  at  10"^  error  rate  becomes  O.OC35. 

Thus,  it  appt^rs  that  the  occurrence  of  more  than  one  error  burst  per  line 
will  be  a relatively  rare  event  if  the  bit  error  rate  is  10  ',  so  that 
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extrapolation  to  lower  error  rates  can  be  easily  made. 

A different  error  rate  could  be  used  for  the  Objective  and  Subjective 
testa.  This  could  be  done  if  the  error  rate  chosen  for  the  Objective  test 
produced  an  image  that  was  beyond  recognition.  However,  the  results  ob- 
tained by  the  French  PTT  Administration,  at  an  error  irate  of  about  10 
show  reasonably  good  results,  at  least  good  enough  to  make  judgments  of 
relative  performance.  Therefore,  it  is  recomen ded  that  an  error  rate  of 
about  10“^  be  used  for  both  Objective  and  Subjective  tests.  This  will 
minimize  the  amount  of  computer  simulation  required. 

The  length  of  the  error  pattern  was  specified  as  10^  bits,  which  is 
expected  to  be  longer  than  any  one  encoded  image. 

The  Federal  Republic  of  Germany  has  already  made  recordings  of 

7 

error  patterns  meeting  all  of  the  above  requirements.  A standard  set 
of  these  measurements  should  be  used  for  these  tests.  The  approximately 
1000  error  positions  in  10^  bits  should  be  provided  on  magnetic  tape  or 
punch  cards  for  use  by  experimenters. 

U.3  Sample  Size 

The  number  of  images  that  are  processed  in  the  Error  Sensitivity 
test  must  be  sufficient  to  provide  a statistically  meaningful  estimate  of 
the  true  error  sensitivity.  However,  the  number  of  images  that  are  pro- 
cessed must  be  minimized  to  keep  the  amount  of  computer  time  required  for 
the  simulation  within  bounds.  While  only  two  Test  Documents  have  been 
chosen  for  error  sensitivity  testing,  any  number  of  images  may  be  pro- 
cessed, simply  by  applying  a different  error  pattern  to  the  two  Test 
Documents.  In  fact,  the  same  error  pattern  can  be  used  to  produce  different 


received  images  simply  by  shifting  the  error  pattern  'elative  to  tha 
transmitted  bit  stream  so  that  errors  impinge  on  different  code  words, 
thereby  producing  an  independent  evaluation  of  the  error  sensitivity. 

It  ie  propoeed  that  the  traaemiealon  be  delayed  by  1 ,02h  bite  relative 
to  the  error  pattern  on  each  teat  of  the  same  Teat  Document.  This  shift 
is  intended  to  be  larger  than  the  number  of  bite  ueed  to  repreeent  a line, 
but  email  enough  so  that  succeeding  tests  use  substantially  the  same  bit 
errors,  which  will  minimise  the  fluctuations  from  one  trial  to  another. 
Also,  the  delay  should  not  be  a multiple  of  U8  bits,  the  minimum  number  of 
bits  that  can  represent  a line,  so  that  the  error  pattern  should  Impact 
a different  part  of  the  code  each  time  it  is  used. 

The  accuracy  of  the  estimate  of  error  sensitivity  will  depend,  to  a 
large  extent,  on  the  number  of  relatively  rare  events,  such  as  errors  in 
BDL  codes,  that  can  be  expected  in  the  documents  that  are  processed.  It 
is  proposed  that  for  the  standard  resolution  images,  three  runs  be  made  of 
each  Test  Document  with  different  phases  of  the  error  pattern.  Some  numer- 
ical calculations  will  serve  to  illustrate  the  accuracy  that  can  be 
expected  in  the  estimation  of  the  Error  Sensitivity  Factor  (ES7). 

The  numbers  used  in  this  calculation  are  derived  from  Table  2 of 
the  Federal  Republic  of  Germany  paDer.  The  average  figures  for  the 
EIA  Code  are  used,  but  the  same  figures  for  the  ITC  Code  are  not  much  dif- 
ferent. The  average  number  of  lost  pels  on  a line  due  to  an  error  burst 
causing  incorrect  run  length  codes  is  almost  SCO.  If  a burst  of  5 errors 
is  assumed,  the  number  of  oels  in  error  per  bit  error  is  IOC.  For  standard 
resolution  and  a compression  factor  of  10,  the  transmission  will  be  183,85° 
bits  long,  and  will  attract  about  I8ii  bit  errors  at  an  error  rate  of  10”'. 
Thus,  there  will  be  about  1 SU  I 100  » 13,U0C  pel  errors  due  to  incorrect 
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ran  length  codes.  Because  of  the  large  number  of  events  Involved  in  each 
document,  It  is  expected  that  the  ESP  due  to  incorrect  ran  length  codes 
mill  be  quite  stable  from  document  to  document.  The  bulk  of  the  variation  in 
BSP  is  expected  to  arise  from  less  frequent  events,  each  of  which  causes 
a large  number  of  pels  to  be  in  error.  The  principal  event  of  this  type  will 
probably  be  a missing  SOL  or  a false  SOL.  The  data  of  Table  2 indicates  an 
average  of  about  2 of  each  of  these  events  per  document,  at  a bit  error 
rate  of  about  5 X 10"^.  The  bit  error  rate  must  be  doubled  to  make  it 
comparable  to  the  proposed  rate  of  10"^,  so  the  average  number  of  each 
of  the  events  per  documents  will  also  double  to  U.  The  actual  number  of  events 
in  a document  should  be  Poisson  distributed,  since  there  are  many  chances 
for  the  event  to  occur,  but  each  chance  has  a very  low  probability. 

Therefore,  the  standard  deviation  of  the  number  of  events  is  the  square 
root  of  the  average  number  of  events.  Por  this  ease,  the  standard 
deviation  would  be  two  events.  If  it  is  assumed  that  the  number  of  pel 
errors  that  result  from  each  event  is  1,728,  then  the  average  pel  errors 
per  document  from  all  causes  becomes 

l8,h00  «■(!*!  1728)  - 25,312  pels 
while  the  standard  deviation  becomes: 

2 I 1,728  - 3,U56  pels 

which  is  1U<  of  the  average.  If  the  average  of  three  documents  is  taken, 
the  standard  deviation  is  reduced  by  7T,  or  to  8%  of  the  average.  This  is 
a reasonably  good  accuracy  and  will  not  be  improved  substantially  by  a 
modest  increase  in  the  number  of  documents  processed.  Further,  it  should 
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be  not«d  that  tha  error  in  the  ESF  estimate  will  b«  reduced  byj 
e a lower  compression  factor 

e a higher  ESF  due  to  incorrect  run  lengths  alone 
e less  than  1,726  pel  errors  per  K)L  event 
e consideration  of  both  missing  and  false  BOL  events 
Therefore,  it  is  concluded  that  three  runs  of  the  standard  resolution 
document  should  provide  a reasonable  accuracy  in  the  estimation  of  the 
ESF.  For  the  high  resolution  case,  there  should  be  more  transmission 
bits,  transmission  errors,  BOL  codes,  and  BOL  errors,  thus  reducing  the 
variations  in  the  ESF  measurement.  Therefore,  it  is  recommended  that  only 
two  runs  be  made  on  each  document  for  high  resolution  scanning. 

Having  obtained  the  ESF  for  each  of  the  three  runs,  ESF^ , ES?2,  BSF-j, 
the  average  is  calculated  to  bet 


The  best  estimate  of  the  variance  of  the  population  is  given  byt 


and  the  estimate  of  the  variance  of  the  sample  average  is 


For  three  documents  the  standard  deviation  of  tbs  sstlaats  of  tbs  average 
BF  1st  i — _ 
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(ESF,)^  (ESF.,)2  ♦ (ESF3)?  - 3(8SFavg)? 
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For  two  saaplea  proposed  for  tbe  high- resolut Ion  case,  we  have! 
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avg 


(EST^)2  ♦ (BSFg)2  - 2(BSFavg)2 


The  standard  deviation  of  the  estimate  of  the  ESF  Is  useful  as  a check 
on  the  adequacy  of  the  saaiple  slse  and  gives  an  indication  of  whether  meas- 
ured differences  between  the  SSF's  of  contending  coding  techniques  are 
statistically  significant.  As  a rule  of  thumb,  the  difference  between 
the  average  ESF's  should  be  equal  to  or  greater  than  the  sum  of  their 
standard  deviations  to  be  considered  statistically  significant. 


U.U  Evaluation 

The  Images  produced  by  decoding  the  error-laden  transmission  are 
compared,  pel  by  pel,  with  the  original  image.  A cotint  is  made  of  the 
number  of  pels  that  differ  In  "color"  from  the  original.  This  is  divided 
by  the  number  of  bit  errors  that  actually  Impinged  on  the  transmission, 
to  yield  the  ESF  for  that  trial.  Normally,  no  movement  of  received  oels 
relative  to  the  original  image  will  be  permitted  to  achieve  a closer  match 
with  the  original.  An  exception  to  this  rule  is  that  if  an  entire  line 
is  added  or  drocoed,  usually  due  to  ECL  code  errors,  a penalty  will  be 
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assessed  only  for  the  first  received  line  that  is  matched  with  the  incorrect 
original  line.  In  order  for  the  comparison  algorithm  to  keep  track  of 
which  lfcm  is  which,  each  EOL  should  by  numbered  in  the  original  transmission 
and  in  the  received  transmission.  This  number  would  not  of  course  be 
available  to  the  decoding  algorithm,  but  only  to  the  comparison  algorithm. 

Perhaps  the  most  difficult  decision  made  during  this  study  was  the 
degree  to  which  various  error  correction  schemes  could  be  utilized  to  reduce 
the  ESF,  both  for  the  Objective  measure  and  the  Subjective  measure.  It  is 
possible  to  define  the  CP  for  a Coding  Technique,  quite  apart  from  the 
decoding  algorithm,  as  long  as  it  can  be  shown  that  there  is,  in  fact, an 
algorithm  that  will  exactly  produce  the  original  image.  On  the  other  hand, 
the  ESF  cannot  be  evaluated  from  a knowledge  of  the  coding  technique  alone; 
the  decoding  algorithm  must  also  be  known.  The  proposed  standards  are  for 
coding  techniques  only;  each  manufacturer  can  use  any  decoding  approach 
he  wishes  to.  Hence,  there  is  an  inherent  difficulty  in  estimating  the  ESF. 

Clearly,  the  coding  technique  must  include  a decoding  algorithm  in 
order  to  evaluate  it  for  error  sensitivity,  despite  the  fact  that  only  the 
encoding  is  to  be  standardized.  The  question  is,  how  much  latitude  can 
be  given  to  the  decoding  algorithm  to  correct  errors  with  sophisticated 
schemes'*  One  side  of  the  argument  says  that  only  that  amount  of  decoding 
actually  required  to  correctly  reproduce  an  image  from  an  error-free 
transmission  should  be  used.  The  rationale  for  this  is  that  it  is  the 
encoding  that  is  to  be  standardized  and  tested,  and  therefore  any  error 
correction  will  only  mask  the  inherent  qualities  of  the  coding  technique. 
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Vto  hare  rejected  this  approach  for  the  following  reasons t 

(1)  It  is  difficult  and  arbitrary  to  separate  a decoding  algor- 
ithm into  those  parts  required  for  error- free  reception  and 
those  designed  to  correct  for  transmission  errors. 

(2)  Coding  techniques  that  provide  a controlled  amount  of 
redundancy  for  error  control  will  be  unfairly  punished, 
since  their  compression  factor  will  be  low  because  of  the 
increased  redundancy  without  the  commensurate  gain  due  to 
a lower  error  sensitivity. 

(3)  It  will  favor  encoding  techniques  that  minimize  exposure 
to  errors  by  minimizing  the  length  of  critical  words, 
such  as  BOL,  rather  than  adding  controlled  redundancy. 


Therefore,  it  is  proposed  that  any  decoding  algorithm  proposed  by 
an  experimenter  be  accepted,  providing  that  it  is  fully  disclosed  and 
documented.  This  will  allow  the  full  use  of  whatever  redundancy  is  oro- 
vided  in  the  transmission  to  provide  error  control.  If  excessively  complex 
error  correction  schemes  are  proposed,  they  will  be  penalized  under  the 
"Base  of  Implementation"  criteria.  It  is  expected  that  more  than  one  de- 
coding algorithm  will  be  proposed  for  each  coding  techniaue,  in  order  to 
demonstrate  that  the  coding  technique  can  be  used  with  decoding  algorithms 
of  varying  complexity.  In  this  case,  each  decoding  algorithm  must  be 
evaluated  for  error  sensitivity. 

Subjective  evaluation  must  be  done  with  high-quality  images  of  the 
received  pictures.  If  possible,  they  should  all  be  made  on  the  same 
tyoe  of  equipment,  in  order  to  eliminate  the  subjective  effects  of  contrast 
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and  resolution. 


The  coat  to  implement  the  candidate  coding  techniques  is  one  of  the 
important  parameters  in  the  selection  process.  Cost  is  also  one  evalua- 
tion criterion  which  would  seem  to  be  expressible  in  hard  quantitative 
form.  Unfortunately , it  is  unrealistic  to  expect,  or  request,  equipment 
design  or  cost  information  from  organizations  proposing  a compression 
algorithm.  The  competitive  aspect  of  the  facsimile  business  totally 
inhibits  the  availability  of  such  data.  Even  if  cost  information  were 
available  from  manufacturers,  it  is  likely  that  the  data  would  vary  over 
a wide  range  due  to  the  great  variability  of  design  and  manufacturing 
philosophies.  For  example,  the  design  objectives  for  different  companies 
would  differ  greatly  from  the  standpoint  of  systems  reliability,  human 
factors,  size,  ease  of  repair,  and  power,  to  name  a few.  These  different 
design  philosophies  and  objectives  have  far-reaching  implications  as  far 
as  equipment  cost  is  concerned.  A similar  type  of  variability  occurs  in 
the  manufacturing  area.  For  example,  the  size  and  efficiency  of  the 
manufacturing  facility  has  a large  impact  on  equipment  cost.  There  is 
also  a question  of  the  production  volume  and  the  time  frame  of  the  pro- 
duction . 

Due  to  the  wide  range  of  cost  factors  enumerated  in  the  paragraph 
above,  it  is  very  difficult  for  a committee  such  as  the  EIA  or  CCTTT  to 
develop  hard,  meaningful  cost  data  to  aid  in  the  selection  process  of  a 
compression  techniaue.  It  is  understood  however,  that  each  committee 
member  will,  in  his  own  way,  be  estimating  the  costs  of  the  candidate 
techniques;  and  these  relative  costs  will,  and  should,  weigh  heavily 


in  the  decision  process. 

Above  and  beyond  the  cost  factors  discussed  above,  is  one  important 
issue  which  deserves  special  attention  - patent  and  royalty  considerations. 
It  is  generally  agreed  that  it  is  critically  important  that  a proposed 
coding  technique  be  free  of  any  royalty  considerations. 
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6.0  Compatibility  with  Other  Facsimile  Machines 

It  la  obviously  highly  advantageeoua  to  the  facsimile  community 
and  systems  users  for  different  classes  of  machines  to  , compatible, 
i.e.  interoperable.  Since  the  compression  coding  tachnique  is  a key 
factor  in  compatibility,  it  is  clearly  desirable  to  consider  this  issue 
when  selecting  a code  for  Group  U and  the  two-dimensional  extension 
of  Group  3. 

Three  different  types  of  compatibility  factors  are  present: 

1.  Group  3/Group  U 2.  Group  3 (l  dimensional)/  Group  3 (2  dimensional) 

3.  Machines  with  greater  document  width.  Each  of  the  compatibility 
issues  is  discussed  below. 

Group  3 /Group  U 

Since  the  Group  U machine  will  operate  over  data  networks,  the  bit 
error  rate  of  the  communication  channel  will  be  very  low.  For  this  reason 
it  would  be  possible  to  consider  two-dimensional  codes  for  Group  ii  equip- 
ment which  are  much  more  sensitive  to  transmission  errors  than  might  be 
considered  for  Group  3 machines.  This  difference  in  error  sensitivity 
may  be  sufficiently  fundamental  that  different  two-dimensional  codes 
would  be  chosen  for  the  two  systems.  It  must  be  recognized,  however,  that 
if  two  different  codes  were  selected,  a significant  penalty  would  be 
paid  in  the  cost  to  achieve  compatibility.  In  other  words,  it  would  clear- 
ly be  desirable  for  the  Group  Li  machine  and  extended  Group  3 systems  to  employ 
the  same  code,  and  this  factor  must  be  carefully  considered  in  the  eval- 
uation process. 
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Group  3 (l-dimenslonal) /Group  3 (2-dimensional) 

There  is  obviously  a very  strong  motivation  for  the  basic  Group  3 
machine  with  the  one-dimensional  code  to  be  compatible  with  the  optional 
Group  3 machine  with  the  two-dimensional  code.  If  necessary,  compati- 
bility can  be  achieved  by  implementing  systems  with  both  codes  so  they  can 
communicate  with  either  type  of  equipment.  However,  it  may  be  possible  to 
select  a two-dimensional  code  which  uses  the  one  dimensional  code  as  a 
functional  element.  Stated  another  way,  it  may  be  possible  to  select 
a two-dimensional  code  which  is  an  extension  of  the  one- dimensional 
code.  If  this  could  be  done,  the  cost  of  equipment  compatibility  would 
obviously  be  reduced. 

Machines  with  Greater  Document  Width 

It  is  desirable  to  select  a compression  algorithm  which  can  be 
economically  extended  for  application  to  documents  wider  than  that  for 
the  Group  3 machines.  For  example,  it  may  be  desired  to  double  the 
document  width  so  that  a total  of  3>U56  pels/line  would  be  transmitted. 

It  would  be  advantageous  for  the  code  for  the  wide  document  to  be  merely 
an  extension  of  the  normal  width  code  for  reasons  of  compatibility  and 
cost  minimization. 
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7.0 

One  major  purpose  of  this  document  is  to  assist  persons  or  commit* 
tees  In  selecting  a standard  facsimile  algorithm.  Toward  this  end,  it 
would  be  very  helpful  to  rank  the  four  evaluation  criteria  in  terms  of 
their  relative  importance.  Unfortunately,  this  is  very  difficult  to  do 
for  three  reasons.  First,  various  committees  and  committee  members  have 
widely  varying  perspectives  and  orientations  relative  to  the  criteria. 
Secondly,  the  criteria  are  not  independent,  but  in  many  cases  interact 
in  complex  ways.  The  third  difficulty  concerns  the  fact  that  two  of  the 
criteria  (cost,  compatibility)  are  difficult  to  quantify.  These  three 
points  are  discussed  in  the  paragraphs  below. 


Relative 


uortance  of  the  Criteria 


Perspective 


Different  committees  and  coranittee  members  can  have  widely  varying 


background  and  perspectives  relative  to  the  evaluation  criteria.  For 
example,  it  is  inevitable  that  facsimile  manufacturers  and  common  carrier 
organizations  would  view  the  evaluation  parameters  differently.  In 
addition,  the  market  orientation  of  a vendor  will  greatly  affect  his 
position.  For  instance,  a company  which  manufactures  products  in  large 
volume  and  stresses  conventional  picture  quality  would  view  the  situa- 
tion differently  from  a vendor  who  stresses  the  low  volume/high  quality 
market.  Also,  different  vendors  have  varying  technological  strengths 
in  other  facsimile  subsystems  (such  as  sophisticated  adaptive  modems) 
which  would  affect  their  position.  All  of  these  factors  make  it  extreme- 
ly difficult  to  adoot  a clear  ranking  of  the  evaluation  factors  in  terms 
of  their  relative  importance. 
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Criteria  Interdependency 

It  is  vory  difficult  to  rank  the  evaluation  criteria  due  to  the 
large  degree  of  interdependency  and  interaction  which  exists  between 
then.  For  example , some  facsimile  systems  can  automatically  reduce  the 
transmission  rate  to  the  point  where  an  acceptable  error  rate  is  achieved. 
This  results  in  a trade-off  between  error  sensitivity  and  compression. 
Another  trade-off  could  exist  between  error  sensitivity  and  implementa- 
tion cost.  At  one  extreme  could  he  a compression  system  which  is  very 
sensitive  to  transmission  errors  but  which  employs  a very  complex  post- 
decoder, error- reduction  scheme  to  minimize  the  visual  effect  of  errors. 

At  the  other  extreme  could  be  a coder  which  inserts  sufficient  redundancy 
into  the  transmitted  code  to  correct  for  some  transmission  errors.  In  this 
case,  the  system  is  relatively  Insensitive  to  channel  errors,  may  be  less 
expensive,  and  would  have  a reduced  compression  ratio. 


Qualitative  Criteria 

Although  the  cost  and  compatibility  criteria  are  potentially 
quantifiable,  it  was  pointed  out  in  Sections  5.0  and  6.0  that  these 
parameters  can  only  be  dealt  with  in  qualitative  terms  in  this  case.  It 
is  obviously  difficult  to  rank  parameters  which  are  exoressed  only  on  a 
qualitative  basis. 


Summary 

In  view  of  the  many  reasons  which  make  it  difficult  to  rank  the 
four  evaluation  parameters,  the  draft  proposal  in  Appendix  A merely 
discusses  each  crt4 urion  in  aualitative  terms,  but  does  net  attempt  to 
establish  their  relative  L-roortance  in  Quantitative  terms 
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Recommendation  for  Further  Stu 


Subroutine  No. j Function  j 

Simulated  Input 

I 


Output 


Encoder 


Input  Image 
Tape 


• Compression 
Factor 

e Tape  with  Trans- 
mitted Code  (T1 ) 


e T1  e Tape  with  Re-  i 

e Error  ceived  Code  (T2) 

Pattern  ! 


Transmission 

Errors 


Decoder 


• Error  Sensitivity 

Factor 

• Output  Image  Tape 


As  a result  of  this  contract,  specific  computer  simulation  proce- 
dures have  been  recommended  for  the  measurement  of  Compression  Factor  (CF) 
and  Error  Sensitivity  Factor  (ESF) . As  a reconmendation  for  further 
study,  it  is  proposed  to  write  the  computer  programs  to  perform  these 
measurements  on  actual  imagery  data.  An  Executive  routine  would  be 
written  to  control  the  overall  program  operation.  Three  subroutines 
would  be  written  which  are  summarized  in  the  table  below. 


Following  the  running  of  the  three  subroutines  described  above  the 
Output  Image  Tape  would  be  converted  to  visual  form.  It  is  proposed  to 
simulate  the  one-dimensional  code  which  has  been  chosen  as  a standard  by 
the  El A Facsimile  subcommittee.  Since  a great  deal  of  prior  simulation 
work  has  been  done  on  this  code,  it  would  provide  an  ideal  vehicle  for 
cross-checking  and  verification  of  simulation  accuracy. 
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Draft  Copy  of  "Criteria  for  the 
Evaluation  of  Tvo-Dinenaional  Coding 
Techniques  for  use  in  Digital  Facsimile  Terminals" 
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Date<  December  1978 

Qoeationa : 2/XTV 
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SOURCE:  UNITED  STATES  OF  AMERICA 

TITLE!  CRITfflTA  FOR  THE  EVALUATION  OF  TNO-DIMDJSIONAL  CODING  TECHNIQUES 
FOR  USE  IN  DIGITAL  FACSIMILE  TERMINALS 

1.0  Sum  ary 

This  document  proposes  the  use  of  four  criteria  for  the  evaluation 
of  two-dimensional  coding  techniques  for  use  is  digital  facsimile  ter- 
minals. 

e Compression  Factor 

• Error  Sensitivity  Factor 

• Cost  of  Implementation 

e Commonality  with  other  Facsimile  Codes 
The  proposed  criteria  are  apolicabla  for  both  Group  2j  machines  and  the 
optional  extension  of  the  Group  3 machine  to  include  a two-dimensional 
code.  The  oroposal  is  apolicable  for  both  the  normal  resolution  (3.85 
lines/mm)  and  high  resolution  (7.7  lines/mm)  scanning  standards. 

2.0  Background 

The  CCITT  is  actively  reviewing  and  considering  the  standardisation 

of  two-dimensional  coding  techniaues  for  the  optional  extension  of  the 

Group  3 on e-dimen sicnal  code.  In  the  future,  consideration  will  also  be 

2 

given  to  coding  techniques  for  Group  U apoaratus  . Several  papers  have 
been  publ^s^ed  recently  describing  particular  two-dimensional  coding 


techniques  and  their  performance  in  terms  of  compression  ratio  and  error 
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sensitivity. 


Unfortunately,  it  is  difficult  to  compare  the  results  of 


different  coding  techniques  and  different  investigators  because  the  per- 
formance measurements  are  frequesntly  not  carried  out  under  the  same  con- 
ditions. The  primary  purpose  of  this  document  is  to  define  a set  of  prag- 
matic test  conditions  in  sufficient  detail  so  that  all  organisations  that 
wish  to  have  a coding  technique  selected  as  a standard  by  the  CCITT  will 
have  a specified  procedure  to  follow  to  insure  all  proposals  will  be  eval- 
uated on  a common  meaningful  basis. 

Much  has  been  proposed  to  the  CCITT  and  published  in  the  literature 
relative  to  the  subject  of  this  paper.  This  proposal  has  attempted  to  draw 
upon  and  integrate  this  prior  work  as  much  as  possible.  Section  U.O  is  a 
list  of  References  which  have  been  particularly  noteworthy  and  helpful. 


3.0  Proposed  Criteria 


3.1  Compression  Factor 


3.1.1  Test  Documents 

Experimenters  in  the  field  of  facsimile  data  compression  have  utilised 
a wide  range  of  test  documents  to  measure  compression  ratio  and  error 
sensitivity.  The  8 CCITT  test  documents  have  achieved  a wider  range  of 
acceptance  than  other  documents  and  are  somewhat  representative  of  the 
pages  likely  to  be  transmitted  through  digital  facsimile  systems.  Con- 
sequently, the  8 CCITT  documents  have  been  selected  for  use  in  the  eval- 
uation process  described  herein.  The  French  PTT  Actainistration  has  scanned 
these  8 CCITT  documents  at  both  the  standard  and  high  resolutions  as 
specified  for  Group  3 machines.  They  have  also  auantized  each  pel  to  be 
either  black  or  white  and  stored  the  resultant  image  on  magnetic  tape. 
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Further,  the  French  PTT  has  provided  copies  of  these  tapes  to  experiment* 
ere  In  the  data  cosipression  field  so  that  facsimile  performance  data  can 
be  compared  on  a meaningful  basis.  For  these  reasons,  it  is  recomended 
that  the  measurements  proposed  herein  be  perfomed  using  the  tapes  supplied 
by  the  French  PTT  Administration . 

3.1.2  Measurement  of  Compression  Factor  (CF) 

Any  proposed  encoding  technique  must  be  fully  defined  in  sufficient 
detail  to  permit  other  investigators  to  duplicate  the  performance  measure- 
ment process.  The  Compression  Factor  (CF)  will  be  determined  for  each 
of  the  8 CCITT  test  documents  and  for  both  the  standard  and  high  resolution. 

The  first  step  in  the  measurement  process  is  to  simulate  the  encoding 
function  and  accumulate  a count  of  the  code  bits  required  to  transmit  each 
document.  The  CF  for  each  document  is  then  computed  by  dividing  the  total 
number  of  picture  elements  (pels)  per  test  page*  by  the  number  of  trans- 
mitted code  bits. 

Two  different  compression  factors  will  be  determined.  The  first 
establishes  the  CF  of  the  basic  algorithm  and  excludes  synchronization 
and  fill  bits  from  the  transmitted  code  bits.  This  parameter  is  not  only 
useful  to  represent  the  performance  of  the  basic  algorithm  but  also  closely 
approximates  the  actual  compression  performance  which  will  be  achieved 
when  operating  in  a Grouo  Li  configuration.  For  this  reason  the  compression 
factor  is  designated  CF^. 


* The  oicture  taoes  from  the  French  PTT  contain  the  following  pels: 

Standard  Resolution  - (ICoii  lines) (1728  pels/line)  * 1,338,5°2  pels 

High  Resolution  - (2128  lines) (1 728  pels/line)  - 3,677,l8ii  pels 

A-  3 THIS  PAGE  IS  BEST  Q UAL ITT  PRAOTIWBia 

FROM  COPY  rUWMISHBD  TO  DDC 


The  second  compression  factor  parameter  (CP3)  is  dsslgnsd  to  represent 
the  compression  ratio  when  tha  algorithm  is  employed  in  a typical  Group  3 
machine.  In  this  case  all  synchronisation  bits  such  as  the  beginning-of- 


message,  snd-of-llne,  end-of -message , and  fill  bits  are  Included  in  the 
code  bits.  Fill  bits  will  be  generated  asswing  a minimum  line  trans- 
mission tine  of  ms.  and  a transmission  bit  rate  of  U800  bits/sec. 

3.2  Error  Sensitivity 

This  section  describes  the  criteria  for  evaluating  the  sensitivity  of 
two-dimensional  coding  techniques  to  transmission  errors.  The  criteria 
are  valid  for  Group  3 machines.  Measurement  of  error  sensitivity  is 
required  for  standard  resolution  (3-85  lines /w)  and  for  high  resolution 
(7.7  lines/mn). 

To  evaluate  the  error  sensitivity,  both  the  coding  technique  and  the 
decoding  algorithm  must  be  completely  defined  and  disclosed  in  sufficient 
detail  to  permit  computer  simulation  by  any  experimenter.  If  more  than 
one  decoding  algorithm  is  proposed  (for  example,  to  achieve  differing 
levels  of  error  control),  each  must  be  tested  separately  and  fully  dis- 
closed. 

Both  an  Objective  Measure  and  a Subjective  Measure  of  error  sensitiv- 
ity will  be  provided.  The  Objective  Measure  will  provide  a numerical 
estimate  of  error-sensitivity,  while  the  Subjective  Measure  will  provide 
pictorial  material  for  committee  evaluation. 

3.2.1  Objective  Measure 

The  Objective  Measure  of  error  sensitivity  is  obtained  by  selecting 
test  documents,  encoding  them  with  the  proposed  technique,  subjecting  the 
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resulting  bit  stream  to  transmission  errors,  decoding  the  transmission  to 
obtain  the  received  Image,  and  comparing  the  original  image  with  the  re- 
ceived image  to  determine  the  number  of  pels  in  error. 

3. 2. 1.1  Test  Documents 

The  Test  Documents  to  be  used  for  the  error  sensitivity  test  are 
CCITT  Test  Documents  1 and  U.  Each  of  the  documents  would  be  coded 
according  to  the  proposed  coding  technique.  Synchronisation  and  fill  bits 
will  be  included.  This  encoding  will  have  been  done  as  part  of  the 
measurement  of  Compression  Factor  for  Qroup  3 Machines  (see  section  3.1.2). 

3. 2. 1.2  Srror  Patterns 

A record  will  be  ororided  of  actual  bit  errors  made  over  telephone 
lines.  This  will  be  obtained  by  transmitting  a known  psuedorandom  sequence 
at  U800  bits/sec.  using  a V27  ter  modem  over  a switched  telephone  network. 
The  average  bit  error  rate  will  be  aooroximately  1 I 10  ' (between  7 I 10 
and  l.U  Z 10"^) , and  the  length  will  be  at  least  10^  transmission  bits 

(corresponding  to  about  3.5  minutes  of  transmission  time).  Measurements 

li  6 7 

of  this  type  have  already  been  made  by  the  Federal  Reoublic  of  Germany  ' * 
and  may  be  available  to  experimenters  for  this  purpose.  The  measured 
error  pattern  will  be  converted  to  the  bit  locations  of  errors  and  can  be 
supplied  on  magnetic  tape  or  punched  cards. 

The  supolied  error  pattern  is  apolied  to  the  encoded  transmission, 
causing  a bit  reversal  at  each  oolnt  where  an  error  is  indicated.  There 
will  be  three  runs  for  each  normal  resolution  (3.9?  lines, 'mm)  test  document. 
For  the  first  run,  the  first  bit  of  the  error  pattern  is  aligned  with  the 
first  bit  of  the  encoded  transmission.  For  subsequent  runs,  the  trans- 
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mission  is  delayed  1,02U  bits  relative  to  the  previous  run  so  as  to  obtain 
a different  phasing  of  errors  relative  to  critical  code  words.  A count  is 
made  of  the  number  of  errors  that  actually  impinge  on  each  transmission. 

3. 2. 1.3  Decoding  Transmission 

The  transmission  containing  errors  is  than  decoded  by  the  proposed 
decoding  algorithm  to  produce  a received  Image.  The  decoding  algorithm 
should  define  the  polarity  of  every  pel  in  the  output  image.  If  it  does 
not  for  any  reason  define  a pel,  it  will  be  arbitrarily  set  to  white. 

Note  that  any  error  correction  schemes  may  be  used  providing  they  are  fully 
disclosed  as  part  of  the  proposed  coding  techniques. 

3.2.1.U  Error  Calculation 

Each  pel  of  the  received  image  is  compared  to  the  corresponding  pel 
in  the  original  image  to  determine  if  it  matches,  or  if  it  is  in  error. 

A count  of  the  number  of  pels  in  error  is  made.  In  general,  there  is  one 
scan  line  in  the  output  image  for  every  line  in  the  input  image.  Occasion- 
ally, however,  a transmission  will  cause  an  entire  line  to  be  dropped,  or 
an  extra  line  to  be  added.  When  this  occurs  the  comparison  algorithm  will 
assess  the  appropriate  error  count  for  the  first  time  that  the  original 
line  is  matched  against  a different  line  in  the  received  image.  After  this, 
the  corresponding  lines  will  be  compared.  This  will  prevent  a line  count 
error,  which  is  barely  noticeable,  from  causing  a large  number  of  errors 
on  the  rest  of  the  page. 

The  Error  Sensitivity  Factor  (ESF)  is  calculated  as  the  total  number 
of  pels  in  error  divided  'oy  the  total  number  of  transmission  bits  that  are 
in  error.  This  calculation  is  performed  for  each  run  of  each  test  doctorent. 

The  average  SSF  for  each  test  document  is  calculated  as: 

SSFaT|?  - ESFX  ♦ ESF2  ♦ SSF, 

5 
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The  standard  deviation  of  the  estimate  of  the  ESP  is  useful  as  a check  on 
the  adequacy  of  the  sample  size  and  gives  an  Indication  of  whether  measured 
differences  between  the  ESP's  of  contending  coding  techniqes  are  statistic- 
ally significant.  As  a rule  of  thamb,  the  difference  between  the  average 
ESP's  should  be  equal  to  or  greater  than  the  sum  of  their  standard  deviations 
to  be  considered  statistically  significant. 


3. 2. 1.5  High  Resolution  Simulation 


The  Error  Sensitivity  Pactor  will  be  determined  for  high  resolution 
date  by  performing  only  two  simulation  runs  rather  than  three.  This  is 
justified  due  to  the  greater  number  of  bits  in  the  high  resolution  image. 
In  this  case  the  standard  deviation  is  calculated  as: 


^ * 


3.2.2  Subjective  Measure 


(ESF-l)2  ♦ (ESF2)2  - 2(ESPa^)2l  * 


Each  of  the  ten  received  images  generated  for  the  Objective  Measure 
will  be  made  into  a hard-copy  image  using  a high-quality  (high-resolution, 
high  contrast)  orocess.  It  is  honed  that  a common  facility  will  become 
available  for  reproducing  high-ouality  images  from  magnetic  tape,  or  that  a 
recommendation  will  be  made  for  a suitable  machine  to  be  used  by  exrerimenters . 

The  images  will  be  evaluated  by  the  comnittee  to  determine  the  sub- 
jective nature  of  the  errors.  This  will  include  how  noticeable  the  errors 
are,  hew  objectionable  they  are,  and  an  overall  judgement  of  image  quality. 


3.3  Cost  of  Implementation 

The  coat  to  Implement  the  candidate  coding  techniques  ia  one  of  the 
important  parameters  in  the  selection  process.  Unfortunately,  it  Is 
unrealistic  to  expect,  or  request,  equipment  design  information  from  organ- 
izations proposing  a compression  algorithm.  In  addition,  different  vendors 
of  facsimile  equipment  would  probably  implement  a given  algorithm  in  a 
variety  of  different  ways  depending  upon  the  volume  of  manufacture  and  other 
factors.  Having  recognized  the  difficulty  of  quantitatively  measuring 
this  parameter,  there  are  two  general  comments  listed  below  which  apply. 

e Most  of  the  circuitry  used  to  implement  the  candidate  coding 
is  digital  and  consequently  benefits  from  the  continuous 
cost  reduction  of  digital  components.  Therefore,  the  cost 
differential  between  alternative  techniques  will  probably 
diminish  with  time. 

e It  is  essential  that  a proposed  coding  technique 

be  internationally  available,  free  of  any  royalty  considerations. 

3.U  Conmonality  with  other  Facsimile  Codes 

3.U.1  Group  3 / Group  U Compatibility 

It  is  possible  that  the  ideal  coda  for  the  Group  U machine  would  differ 
from  the  ideal  code  for  the  Group  3 extension  from  the  one-dimensional  cede. 
However,  it  is  desirable  to  select  one  standard  two-dimensional 
code  which  would  be  used  in  both  systems  in  order  to  achieve  machine 
compatibility.  The  objective  would  be  to  select  a cede  which  provides  the 
best  overall  performance  for  both  Group  3 and  Group  U system  configurations. 


It  ia  very  critical  for  the  two  possible  Group  3 machines  (one- 
dimensional  code,  and  two-dimensional  code)  to  be  compatible.  To  minimize 
the  cost  of  this  compatibility  it  would  be  desirable  to  select  a two- 
dimensional  code  which  is  based  upon  an  extension  of  the  one- dimensional 
code  as  much  as  possible. 

3.U.2  Machines  with  Greater  Document  Width 

It  is  desirable  to  select  a compression  algorithm  which  can  be 
economically  extended  for  application  to  documents  wider  than  that  for  the 
Group  3 machines.  For  example,  it  may  be  desired  to  double  the  document 
width  so  that  a total  of  3>U56  pelsAine  would  be  transmitted.  It  would 
be  advantageous  for  the  code  for  the  wide  document  to  be  merely  an  extension 
of  the  normal  width  code  for  reasons  of  compatibility  and  cost  minimization. 

3.5  Relative  Importance  of  the  Criteria 

One  major  purpose  of  this  document  is  to  assist  persons  or  committees 
in  selecting  a standard  facsimile  coding  algorithm.  Toward  this  end,  it 
would  be  very  helpful  to  rank  the  four  evaluation  criteria  in  terms  of 
their  relative  importance.  Unfortunately,  this  is  very  difficult  to  do 
because  of  the  widely  varying  perspectives  and  orientations  of  different 
committees  and  committee  members.  For  example,  it  is  inevitable  that 
facsimile  manuf acturers  and  common  carrier  organizations  would  view  the 
evaluation  parameters  differently.  In  addition,  the  market  orientation 
of  a vendor  will  greatly  affect  his  position  on  the  evaluation  criteria. 

For  example,  a corroany  which  manufactures  high  volume  oroducts  which  stress 
conventional  picture  quality  would  view  the  situation  very  differently 
from  a vendor  who  stresses  the  low  7olume/high  Quality  market.  Having 
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recognised  the  difficulty  of  precisely  ranking  the  criteria,  the  following 
general  comments  are  provided  for  each  of  the  evaluation  parameters. 


Compression  factor 

It  is  very  possible  that  the  Compression  Factors  of  the  candidate 
compression  techniques  will  not  vary  widely,  in  which  case  this  parameter 
may  not  be  critical  in  the  decision  process.  If,  however,  one  coding 
alternative  exhibits  an  unusually  high  or  low  Compression  Factor,  this 
parameter  would  obviously  become  important. 

Error  Sensitivity 

The  Error  Sensitivity  Factor  is  much  more  important  for  Group  3 
machines  than  Group  U machines  due  to  the  different  transmission  error 
rate  conditions.  This  parameter  is  particularly  difficult  to  rank  due  to 
the  potential  high  degree  of  interaction  with  other  evaluation  criteria. 

For  example,  some  facsimile  systems  can  automatically  reduce  the  transmission 
rate  to  the  point  where  an  acceptable  error  rate  is  achieved.  This  results 
in  a trade-off  between  error  sensitivity  and  compression. 

Another  trade-off  could  exist  between  error  sensitivity  and  implementa- 
tion cost.  At  one  extreme  could  be  a compression  system  which  is  very  sen- 
sitive to  transmission  errors  but  which  employs  a very  complex  post-decoder, 
error-reduction  scheme  to  minimize  the  visual  effect  of  errors.  At  the 
other  extreme  could  be  a coder  which  inserts  sufficient  redundancy  into  the 
transmitted  code  to  correct  for  some  transmission  errors.  In  this  case, 
the  system  is  relatively  insensitive  to  channel  errors,  may  be  less 
expensive,  and  would  have  a reduced  compression  ratio. 
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Coat  of  Implementation 

This  parameter  could  become  important  for  some  candidates  which 
involve  very  complex  error  correctors  or  large  buffers.  Again,  it  is 
critical  that  selected  coding  techniques  be  free  of  any  royalty  consi- 
derations . 

4 

Compatibility  with  other  Facsimile  Machines 

It  is  desirable  that  the  two-dimensional  code  selected  for  the 
optional  extension  from  Group  3 be  also  adopted  for  Group  U application. 
Further,  it  is  highly  desirable  that  the  structure  of  this  two-dimensional 
code  be  as  similar  as  possible  to  the  one-dimensional  Group  3 code  and 
that  it  be  extendable  to  greater  document  widths. 

Tabulation  of  Quantitative  Evaluation  Criteria 

Table  1.0  is  a form  for  the  tabulation  of  the  quantitative  evaluation 
criteria  - Compression  Factors  and  Error  Sensitivity  Factors. 


A-11  1 , 


U.O  References 


1.  CCITT  Study  Group  H7,  Contribution  No.  25,  "Report  of  the  Meeting 
held  in  Genera,"  lU-lo  November  1977,  December  1977. 

2.  United  States  of  America,  "Guidelines  to  Establish  Standardisations 
of  Qroup  U Apparatus,"  CCITT  Study  Group  HV  - Contribution  No.  36, 
June  1978. 

3.  Japan,  "Proposal  Concerning  Selection  of  Two-Dimensional  Coding 
System  for  Redundancy  Reduction,"  CCITT  Study  Qroup  HV  - Contribution 
No.  15,  Sept.  13,  1977. 

it.  Mu  smarm,  H.  G.,  and  Preuss,  D. , "Comparison  of  Redundancy  Reducing 
Codes  for  Facsimile  Transmission  of  Documents,"  IEEE  Trans,  on 
Conmuni cat ions,  7ol.  COM.  25,  No.  11,  November  1977,  pp.  Ui25-lli33. 

5.  Japan,  "Proposal  for  Draft  Recommendation  of  Two-Dimensional  Coding 
Scheme,"  CCITT  Study  Group  XT7  - Contribution  No. 

6.  Federal  Republic  of  Germany,  "Sensibility  of  Redundancy  Reducing 
Codes  to  Transmission  Bit  Errors,"  CCITT  Study  Group  HV  - Contribution 
No.  5,  February  1977. 

7.  Federal  Republic  of  Germany,  "Part  1 - Comments  by  the  Administration 
of  the  Federal  Republic  of  Germary  on  the  choice  of  a coding  system 
for  Group  3 facsimile  machines;  Part  2 - Proposal  for  the  Improvement 
of  Line  Synchronisation  for  Group  3 Facsimile  Machines,"  CCITT  Study 
Group  IIV  - Contribution  No.  1U,  August  1977. 

8.  French  Administration,  "Method  for  Evaluating  the  Error  Sensibility 
of  Coding  Systems  for  Digital  Facsimile  Machines,"  CCITT  Study  Group 
nv  - Contribution  No.  U,  March  1977. 

9.  United  Kingdom  Post  Office,  "The  Effect  of  Transmission  Errors  on  the 
EIA  Modified  Huffman  Code  and  the  Development  of  an  Improved  Huffman 
Code"  CCITT  Study  Group  HV  - Contribution  No.  DLi,  November  1977. 


10.  Special  Rapporteur,  "Minutes  of  Meeting  of  the  Special  Rapporteur 
Group  on  Group  3 Machines  held  in  Paris  from  2 to  5 November  1976," 
CCITT  Study  Group  117  - Contribution  No.  7,  March  1977. 


